Search for: All records

The ability to compare objects, scenes, or situations is crucial for effective decision-making and problem-solving in everyday life. For instance, comparing the freshness of apples enables better choices during grocery shopping, while comparing sofa designs helps optimize the aesthetics of our living space. Despite its significance, the comparative capability is largely unexplored in artificial general intelligence (AGI). In this paper, we introduce MLLM-COMPBENCH, a benchmark designed to evaluate the comparative reasoning capability of multimodal large language models (MLLMs). MLLM-COMPBENCH mines and pairs images through visually oriented questions covering eight dimensions of relative comparison: visual attribute, existence, state, emotion, temporality, spatiality, quantity, and quality. We curate a collection of around 40K image pairs using metadata from diverse vision datasets and CLIP similarity scores. These image pairs span a broad array of visual domains, including animals, fashion, sports, and both outdoor and indoor scenes. The questions are carefully crafted to discern relative characteristics between two images and are labeled by human annotators for accuracy and relevance. We use MLLM-COMPBENCH to evaluate recent MLLMs, including GPT-4V(ision), Gemini-Pro, and LLaVA-1.6. Our results reveal notable shortcomings in their comparative abilities. We believe MLLM-COMPBENCH not only sheds light on these limitations but also establishes a solid foundation for future enhancements in the comparative capability of MLLMs. 

Recent advances have greatly increased the capabilities of large language models (LLMs), but our understanding of the models and their safety has not progressed as fast. In this paper we aim to understand LLMs deeper by studying their individual neurons. We build upon previous work showing large language models such as GPT-4 can be useful in explaining what each neuron in a language model does. Specifically, we analyze the effect of the prompt used to generate explanations and show that reformatting the explanation prompt in a more natural way can significantly improve neuron explanation quality and greatly reduce computational cost. We demonstrate the effects of our new prompts in three different ways, incorporating both automated and human evaluations. 

Islamophobia, a negative predilection towards the Muslim community, is present on social media platforms. In addition to causing harm to victims, it also hurts the reputation of social media platforms that claim to provide a safe online environment for all users. The volume of social media content is impossible to be manually reviewed, thus, it is important to find automated solutions to combat hate speech on social media platforms. Machine learning approaches have been used in the literature as a way to automate hate speech detection. In this paper, we use deep learning techniques to detect Islamophobia over Reddit and topic modeling to analyze the content and reveal topics from comments identified as Islamophobic. Some topics we identified include the Islamic dress code, religious practices, marriage, and politics. To detect Islamophobia, we used deep learning models. The highest performance was achieved with BERTbase+CNN, with an F1-Score of 0.92. 

Abstract Mg‐S batteries hold great promise as a potential alternative to Li‐based technologies. Their further development hinges on solving a few key challenges, including the lower capacity and poorer cycling performance when compared to Li counterparts. At the heart of the issues is the lack of knowledge on polysulfide chemical behaviors in the Mg‐S battery environment. In this Review, a comprehensive overview of the current understanding of polysulfide behaviors in Mg‐S batteries is provided. First, a systematic summary of experimental and computational techniques for polysulfide characterization is provided. Next, conversion pathways for Mg polysulfide species within the battery environment are discussed, highlighting the important role of polysulfide solubility in determining reaction kinetics and overall battery performance. The focus then shifts to the negative effects of polysulfide shuttling on Mg‐S batteries. The authors outline various strategies for achieving an optimal balance between polysulfide solubility and shuttling, including the use of electrolyte additives, polysulfide‐trapping materials, and dual‐functional catalysts. Based on the current understanding, the directions for further advancing knowledge of Mg polysulfide chemistry are identified, emphasizing the integration of experiment with computation as a powerful approach to accelerate the development of Mg‐S battery technology.